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MEDIUM 

(57)Abstract: 

PROBLEM TO BE SOLVED: To display an image of an object viewed from a desired 
direction in the case of displaying the actual object. 

SOLUTION^ A camera 12-i photographs an object 11 and gives image data to a storage 
section 13~L The storage section 13-i stores the received image data and gives the data 
to an image generating section 14 and a selection section 15. When a user 17 changes a 
direction of an image display section 16, the image display section 16 detects the 
direction and gives a detection signal to the image generating section 14 and the 
selection section 15. The image generating section 14 generates new image data from 
the image data fed from the storage section 13-i on the basis of the detection signal and 
gives the generated image data to the selection section 15. The selection section 15 



selects the image data on the basis of the detection signal and gives the selected image 
data to the image display section 16, where the image data are displayed. 



* NOTICES * 

JPO and INPIT are not responsible for any 
damages caused by the use of this translation. 

LThis document has been translated by computer. So the translation may not reflect 
the original precisely. 

2.**** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



CLAIMS 



[Claim(s)] 

[Claim 1]A picture display system comprising: 

Two or more imaging means which picturize an object. 

A displaying means which can change the direction which displays image data 

picturized by said two or more imaging means. 

A detection means to detect direction of said displaying means. 

A selecting means which chooses one image data picturized by said two or more 

imaging means based on a detection result by said detection means, and is outputted 

to said displaying means. 



[Claim 2]The picture display system according to claim 1 having further a picture 
generation means which generates new image data from image data picturized by said 
two or more imaging means based on a detection result by said detection means. 
[Claim 3]The picture display system according to claim 1 having further a memory 
measure which memorizes image data picturized by said two or more imaging means. 
[Claim 4]An image display method comprising: 
Two or more image pick-up steps which picturize an object. 

A displaying step which can change the direction which displays image data picturized 
at said two or more image pick-up steps. 

A detection step which detects direction of said displaying step. 
A selection step which chooses one image data picturized at said two or more image 
pick-up steps based on a detection result in said detection step, and is outputted to 
said displaying step. 

[Claim 5]A distribution medium providing a program which a computer characterized 
by comprising the following which makes a picture display system perform processing 
can read. 

Two or more image pick-up steps which picturize an object. 

A displaying step which can change the direction which displays image data picturized 
at said two or more image pick-up steps. 

A detection step which detects direction of said displaying step. 
A selection step which chooses one image data picturized at said two or more image 
pick-up steps based on a detection result in said detection step, and is outputted to 
said displaying step. 



2.**** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention]This invention relates to the picture display system direction of 
the picture of the object to display also enabled it to change, an image display method, 
and a distribution medium especially according to direction of a display screen about a 
picture display system, an image display method, and a distribution medium. 
[0002] 

[Description of the Prior Art]In recent years, in a zoo, a botanical garden, a museum, 
etc., displaying the picture which photoed and photoed an animal, vegetation, a display 
object, etc. with the camera on a monitor is performed. Thereby, even if it does not 
exhibit objects (an animal, vegetation, a display object, etc.) directly, the visitor can 
know the appearance of the object. 

[0003]By the way, the image display device which displays the object generated 
virtually according to a user's position with computer graphics (CG) is indicated by 
JP,10-11249,A, for example. This image display device 21 comprises the picture 
display part 31 and the CG generation part 32, as shown in drawing 4 . 
[0004]The position sensing device 35 with which the user 34 is equipped detects the 
user's 34 position (especially position of eyes), and supplies the detected signal 
(detecting signal) to the picture display part 31 and the CG generation part 32. 
[0005]The picture display part 31 changes inclination of the display surface 31a so 
that it may counter with the user 34, while rotating the picture display part 31 
horizontally based on the supplied detecting signal. 

[0006]Based on the supplied detecting signal, the CG generation part 32 generates 
the three-dimensional picture (virtual body) 33 corresponding to the position 
(direction) of the display surface 31a of the picture display part 31, and displays the 
generated three-dimensional picture 33 on the picture display part 31. This 



three-dimensional picture 33 is generated so that it may become the picture seen 
from direction of the display surface 31a of the picture display part 31, i.e., the user's 
34 position. However, even if direction of the display surface 31a changes, the 
direction to see only changes, and the three-dimensional picture 33 is displayed so 
that the position may not change. 

[0007]When the user 34 moves to the user's 36 position, direction of the display 
surface 31a of the picture display part 31 turns into direction which counters with the 
user 36 so that it may be shown as the display surface 31 b. At this time, based on the 
detecting signal after movement supplied, the CG generation part 32 generates the 
three-dimensional picture 33, and displays on the picture display part 31 the 
three-dimensional picture 33 seen from the user's 36 position. 
[0008] 

[Problem(s) to be Solved by the Invention]However, in the technique of displaying the 
image photoed with the above-mentioned camera, although the visitor could see the 
image of the object of the regular direction, the technical problem that it could not see 
even if a visitor, for example, wants to see the image of a direction contrary to the 
direction seen now occurred. 

[0009]Although the virtual body (three-dimensional picture) generated with computer 
graphics can be displayed in the device currently indicated by JP,1 0-1 1 249,A 
according to a user's position, The technical problem that a actual object (picture of 
the object which was picturized with the camera and which exists really) could not be 
displayed occurred. 

[0010]This invention is made in view of such a situation, and is a thing. 

When the purpose displays the image of **, it is providing the picture display system 

which can display the image of the direction of desired. 

[0011] 

[Means for Solving the Problem]Two or more imaging means in which the picture 
display system according to claim 1 picturizes an object, A displaying means which 
can change the direction which displays image data picturized by two or more imaging 
means, It has a detection means to detect direction of a displaying means, and a 
selecting means which chooses one image data picturized by two or more imaging 
means based on a detection result by a detection means, and is outputted to a 
displaying means. 

[0012]written this invention is characterized by it having been alike and comprising 
the following at claim 4. 



Two or more image pick-up steps which picturize an object. 

A displaying step which can change the direction which displays image data picturized 
at two or more image pick-up steps. 

A detection step which detects direction of a displaying step. 

A selection step which chooses one image data picturized at two or more image 
pick-up steps based on a detection result in a detection step, and is outputted to a 
displaying step. 

[0013]Two or more image pick-up steps to which the distribution medium according to 
claim 5 picturizes an object, A displaying step which can change the direction which 
displays image data picturized at two or more image pick-up steps, Based on a 
detection result in a detection step which detects direction of a displaying step, and a 
detection step, One image data picturized at two or more image pick-up steps is 
chosen, and a program which a computer which makes a picture display system 
perform processing containing a selection step outputted to a displaying step can read 
is provided. 

[0014]In the picture display system according to claim 1, the image display method 
according to claim 4, and the distribution medium according to claim 5, when 
picturized image data is displayed, the direction is detected, and one image data is 
chosen and displayed based on a detected result. 
[0015] 

[Embodiment of the Invention]Although an embodiment of the invention is described 
below, it is as follows, when an embodiment [ / in the parenthesis after each means ] 
(however, an example) is added and the feature of this invention is described, in order 
to clarify correspondence relation between each means of an invention given in a 
claim, and following embodiments. However, of course, this statement does not mean 
limiting to what indicated each means. 

[0016]Namely, the picture display system according to claim 1, Two or more imaging 
means (for example, the camera 12-1 thru/or 12-n of drawing 1 ) which picturize an 
object, The displaying means (for example, picture display part 16 of drawing 1 ) which 
can change the direction which displays the image data picturized by two or more 
imaging means, It has a detection means (for example, picture display part 16 of 
drawing 1 ) to detect direction of a displaying means, and a selecting means (for 
example, selecting part 15 of drawing 1 ) which chooses one image data picturized by 
two or more imaging means based on the detection result by a detection means, and is 
outputted to a displaying means. 



[0017]The picture display system according to claim 2 is further provided with the 
picture generation means (for example, image generation part 14 of drawing 1 ) which 
generates new image data from the image data picturized by two or more imaging 
means based on the detection result by a detection means. 

[0018]The picture display system according to claim 3 is further provided with the 
memory measure (for example, the storage parts store 13-1 thru/or 13-n of drawing 
1) which memorizes the image data picturized by two or more imaging means. 
[0019] Drawing 1 is a block diagram showing the composition of the 1 embodiment of 
the picture display system 1 of this invention. 

[0020]Camera 12-i (i= 1, 2 n), It is arranged at the position (direction of the picture 

display part 16 mentioned later and corresponding position) on the dome (dotted line 
of drawing 1 ) centering on the object 1 1 (for example, an insect and vegetation), and 
the image data which photoed and photoed the object 1 1 is supplied to storage parts 
store 13-i (i= 1, 2, n). In drawing 1 , although three camera 1 2— i is arranged, of 
course, it may be arranged more. 

[0021]When the object 11 is vegetation, camera 12-i makes photography speed late, 
and supplies the image data which photoed and photoed the object (vegetation) 1 1 to 
storage parts store 13-i. Thereby, the image data which can see the growth record for 
one week of the vegetation (object) 1 1 in 1 minute is memorized, for example. 
[0022]Storage parts store 13-i memorizes the supplied image data temporarily, and 
supplies the memorized image data to the image generation part 14 and the selecting 
part 15. 

[0023]It is being fixed to the plinth 1 6a by the holding part 1 6b, and the picture display 
part 16 is made as [ rotate / upward / between a transverse plane and the backs / 
180 degrees ]. The plinth 16a has become disc-like and is made as [ rotate / in the 
level surface / it / 360 degrees ]. The gear is built in the plinth 16a and the holding 
part 16b, respectively, and by the user 17. If horizontal direction of the picture display 
part 16 or direction (inclination) of a perpendicular direction is changed, the gear will 
rotate and direction (direction of horizontal direction and a sliding direction) of the 
picture display part 16 will be detected by angle of rotation of this gear. 
[0024]If the user 17 changes direction of the picture display part 16, the picture 
display part 16 will detect direction and will supply the detected signal (detection 
signal) to the image generation part 14 and the selecting part 15. If the signal 
(detecting signal) detected with the position sensing device 18 is inputted into the 
picture display part 16, the picture display part 16 will change the direction based on a 
detecting signal. 



[0025]The image generation part 14 generates new image data based on the detection 
signal supplied from the picture display part 16 from two or more image data supplied 
from the storage parts store 13-1 thru/or 13-n. The user 17 is image data when it 
assumes that the image data generated at this time looked at the object 1 1 from 
direction and the same direction of the picture display part 16. The image data 
generated by the image generation part 14 is supplied to the selecting part 15. The 
technique currently indicated by "Steven M.Seitz and Charles R.Dyer, "View Morphing, 
"Proc.SIGGRAPH96, pp.21 -30", etc. is used for the image generation part 14, for 
example, Interpolation formation of the image data of the middle position of the 
camera 12-1 thru/or 12-n is carried out. 

[0026]Based on the detection signal supplied from the picture display part 16, the 
selecting part 15 supplies the image data which chose and chose only one image data 
to the picture display part 16, and displays it. That is, when it judges with camera 12H 
of direction of the picture display part 16 and the same direction existing, the 
selecting part 15 chooses the image data corresponding to the camera, and is made to 
display it on the picture display part 16. When it judges with camera 12-i of direction 
of the picture display part 16 and the same direction not existing, the image data 
generated by the image generation part 14 is chosen, and it is made to display on the 
picture display part 16. 

[0027]In this embodiment, although image data was stored in storage parts store 13-i, 
in displaying on the picture display part 16 the image data photoed by camera 12-i in 
real time, storage parts store 1 3— i becomes unnecessary. At this time, direct supply of 
the image data photoed by camera 12-i is carried out to the image generation part 14 
and the selecting part 15. 

[0028]When camera 12-i covers all the direction, the image generation part 14 
becomes unnecessary. It is because camera 12-i covers all the direction, so it is not 
necessary to generate a new picture. 

[0029]Next, in the picture display system 1 of drawing 1 , the processing operation on 
which the picture corresponding to direction of the picture display part 16 is displayed 
is explained with reference to the flow chart of drawing 2 . Here, the image data which 
photoed the object 11 shall be stored in storage parts store 1 3 — i. 
[0030]First in Step S1, if the user 17 changes the picture display part 16 into 
direction of a request, the picture display part 16 will detect direction and will supply a 
detection signal to the image generation part 14 and the selecting part 15 in Step S2. 
[0031 ]In Step S3, the selecting part 15 judges whether camera 12-i of direction of the 
picture display part 16 and the same direction exists based on the supplied detection 



signal. In Step S3, when judged with camera 12-i of direction of the picture display 
part 16 and the same direction existing, it progresses to step S4 and the selecting 
part 15 chooses direction of the picture display part 16 and the image data of camera 
1 2H of the same direction. 

[0032]In Step S3, when judged with camera 12-i of direction of the picture display 
part 16 and the same direction not existing, it progresses to Step S5 and the image 
generation part 14 generates new image data from two or more image data based on 
the supplied detection signal. That is, the image generation part 14 generates the 
image data assumed that the user 1 7 looked at the object 1 1 from direction and the 
same direction of the picture display part 16, and the generated image data is supplied 
to the selecting part 15. In Step S6, the selecting part 15 chooses the image data 
generated by the image generation part 14. 

[0033]In Step S7, the selecting part 15 supplies the selected image data to the picture 
display part 16, and displays it, and processing operation is ended. 
[0034]Next, in the picture display system 1 of drawing 1 , the processing operation on 
which direction of the picture display part 16 is changed corresponding to the user s 
17 position, and a picture is displayed is explained with reference to the flow chart of 
drawing 3 . 

[0035]First, if the user 17 stops to a position, the position sensing device 18 will 
detect the user's 1 7 position (especially position of eyes), and the signal (detecting 
signal) detected with the position sensing device 18 will be inputted into the picture 
display part 16 in Step S21. 

[0036]The motor is built in the holding part 16b, and this motor makes that direction 
change in Step S22, based on the inputted detecting signal, so that the picture display 
part 16 may be countered with the user 17. 

[0037]In Step S23, the picture display part 16 supplies a detection signal to the image 
generation part 14 and the selecting part 15, and follows it to Step S24. 
[0038]Since processing of Steps S24 thru/or S28 is the same as that of Steps S3 
thru/or S7 of drawing 2 respectively, the explanation is omitted. 

[0039]The transmission medium by networks, such as the Internet, a digital satellite, 
etc. besides information recording media, such as a magnetic disk and CD-ROM, is 
also contained in the distribution medium which provides a user with the computer 
program which performs the above-mentioned processing in this specification. 
[0040]In this specification, the term of a system shall mean the overall device which 
comprises two or more devices, a means, etc. 
[0041] 



[Effect of the Invention]Since direction of a display screen is detected, the image data 
corresponding to the direction is chosen and it was made to display like the above 
according to the picture display system according to claim 1, the image display 
method according to claim 4, and the distribution medium according to claim 5, A user 
becomes possible [ seeing the picture of direction of an objective request ]. 



2.**** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[Drawing 1] It is a block diagram showing the composition of the 1 embodiment of the 
picture display system 1 of this invention. 

[Drawing 2] In the picture display system 1 of drawing 1 , it is a flow chart for explaining 
the processing operation at the time of displaying a picture on the picture display part 
16. 

[Drawing 3j ln the picture display system 1 of drawing 1 , it is a flow chart for explaining 
the processing operation at the time of changing direction of the picture display part 
1 6 corresponding to the user s 1 7 position, and displaying the picture corresponding to 
the direction. 

[Drawing 4] It is a figure for explaining the conventional image display device 21. 
[Description of Notations] 



1 A picture display system and 1 1 [ A selecting part, 16 picture display parts, and 16a 
/ A plinth and 16b / A holding part, 17, 34, and 36 users, ] An object, 12-1, or 12-n A 
camera, 13-1 or a 13-n storage parts store, and 14 An image generation part and 15 
18, 35 position sensing devices, 21 image display devices, and 31 A picture display 
part, and 31a and 31b A display surface, 32 CG generation part, and 33 
three-dimensional pictures 
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Sn§„ «, Bft±fiicg|3l 4tt, MAtf, "Steven M.S 
eitz and Charles R.Dyer, "View Morphing," Proc.SIG 
GRAPH96, pp. 21-30" ^tM^^tlTV^^^ffl^T, 
*^7l 2 — 1 7!jS 1 2-n©ctW{iH©Bfir-£ 

[oo2 6] a^gui 5t±, ja«s^spi 6«*6flaes 
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^i£^%o bps, m$m\ 5«, wts^gpi 6<ofo£ 
tiBii;iPit(D*^9i 2- s ^fe-r^t^Sb^^ 

^©A^tc^LfcBfir-^SiRU BffsS? 
^gpi 6tc||7S£-tt5o £fc, BliS^gn 6©|p]tt 
1 2- i tf#fibft^i:¥iJ5£Lfc*§ 
BfiMfM 4T?^SftfcH«r-*£jIS?U 

Hft*^si5 1 6 tass-a-So 

[0 0 2 7] ft, ^|*0»jBK*l/->Tti, fBtKSP 1 3 10 

an 6fca^****&ttt, lensm 3-i te^st 
cott, a*? 1 2 - i -r-iii^nfciifix- 

So 

[0 0 2 8] tfc, fttv 1 2 - i tf^TOfltfclfMI 

71 2-i tf£T0fit£ffliiLTVS;tei&, SPffeftH 
{£££/&T3j&g#&V^5T'fc5c 20 

[0 0 2 9] <0«C, El 1 0DBffS7JV>XxA 1 fcfeV 
Tv Hft^ffil 6©fatfcftj£L;fcB{££S^£'tf3 
fflfflfcftfcO^T* 0 2©7D-f-+-h$:#pS s l,Tift 
$1-5,, ft, ccwi, 1 lZMBLrmmr 1 -* 

tfiatitsm 3-i t«iW$nT^5feoi:^-5. 

[0 0 3 0] ft-f, Kfel^T, fOffl#l 7 

[0 0 3 1] Xf-yfS 3lO$^X, SSiasi 5li, $ 30 

mi^kaoii^i 2 - i ^#fti-§^s*^ws-r 

5. Xf'^S 3K43^T, Wf^gPl 6©lRl#i:|W| 
U|6il*<Z>**7 1 2- i##ftT5£¥J££n/-di£\ 
-y 7° S 4 £jt#, 3IIRS3 1 5 it, Btt^8B 1 6 CD 

[Rj^^puiRito^^^i 2- i onfir-^^aw-r 

[0 0 3 2] Xy-y/S 3fc*5l/->T, Hit St^pM 6 © 

isjSfciBUJiqjt©**^ 1 2- i «*fipflEL»^fcWS« 

nfci§£, Xx'y7°S 5EJt», Bfi&JSSU 414, « 40 

fcftB*r-**£fi!tt-S. BPS, Bi^Mn 4t±, 
fijffl#l 7tf, »*1 lfcBft^SPl 6<Dfy%tmV 

a t ^ 5 jtfc ^ <ss l ttw»r- * u ltc 
<^r, miRBi 5 a, Bfi&tfffii 4-c£#<*nfcB« 

[0 0 3 3] Xx-y7°S 7t43^T, SfftSBl 5 ti, S 
ffiSMWTOfcTStiSo 50 
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[0 0 3 4] ^C, 0 1 ©B^g^v'XxA 1 fc&t^ 
T, 7<D&g{cWjSLTB#^a5l 6 01*03 

^t?^> mim^zttzmmmcD^x, 03 

[0 0 3 5] 5fc1\ ft|fl§# 1 7 *^OffilHKfi-S±* 

fufi-tV-9-1 8«fUJB#l 7©fil 
S) fct&WU Xx>y7°S2 lfcfcl^T, juB-ty-ti 

[0 0 3 6] HSSPl 6bfcttt-^r««rtJ«SnT* 
T7^S 2 2t*3V>T, Bfta^l 6%, 7 

[0 0 3 7] Xr-y7°S 2 3 tofcU^T. H«Sa*8B 1 6 
«, ^{i^%B{f!MSn 4*J:lfi»R»l 5fc«lft 
U Xf--y7°S 2 4(clt? 0 

[0038] X-r-y7°S24J!!SS2 8 (DmS.it. 
^fn, 02cDXr-y7°S 371jMS 7 O^li:^ DTSS 

[0 0 3 9] «, *Wffl»ffK*JV^T, ±Wl^lT 

ftCti, Itf^X^, CD-ROM* if <D«$BSHS*<*0 

[0 0 4 0] S/c, i/Xf-ACDffl 

[0 0 4 1 ] 

[0 1 ] *mmmm%.^7,7-L 1 

[0 2] 01 tDB^^v'Xri* 1 tt5VT, Bftft^ 

gpi 6tcBft^a^$^s^«iKi^^-rsfci6 

C07D-^^- h^5o 

[0 3] 01 cDBfta^^XrA 1 tC&^T, 1 
7 CDfiSt^fSLTBfia^ 1 6 <DlRjt*g{fc£"ti\ 

[04] mmmim^mwz lzmwrsrcuxom? 

1 Bfi«/Ts^7r A, 1 1 %H*. 12 — 1 TIjS 
12-n 13—1 JbS 1 3 — n IBtSSP, 

1 4 Bft^gis, 1 5 a^gp, i m\m^ 




[02] 



^gggj^Hlgg I s1 



S2 



i S3 

[YES 



S4 





S5 






S6 





I wiem* I s7 



[03] 



S21 



S22 



S23 



< 



YES 



_S24 

\NO 



S25 





f S26 


ilHft**S816fc 




r S27 
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[04] 




Xy. :-36 



■HMaaw 21 



